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Abstract — This paper presents reduced-rank linearly 
constrained minimum variance (LCMV) beamforming 
algorithms based on joint iterative optimization of filters. 
The proposed reduced-rank scheme is based on a constrained 
joint iterative optimization of filters according to the minimum 
variance criterion. The proposed optimization procedure adjusts 
the parameters of a projection matrix and an adaptive reduced- 
rank filter that operates at the output of the bank of filters. 
We describe LCMV expressions for the design of the projection 
matrix and the reduced-rank filter. We then describe stochastic 
gradient and develop recursive least-squares adaptive algorithms 
for their efficient implementation along with automatic rank 
selection techniques. An analysis of the stability and the 
convergence properties of the proposed algorithms is presented 
and semi-analytical expressions are derived for predicting 
their mean squared error (MSE) performance. Simulations for 
a beamforming application show that the proposed scheme 
and algorithms outperform in convergence and tracking the 
existing full-rank and reduced-rank algorithms while requiring 
comparable complexity. 

Index Terms — Adaptive filters, beamforming, constrained op- 
timization, iterative methods. 



I. Introduction 

In recent years, adaptive beamforming techniques have 
attracted considerable interest and found applications in radar, 
wireless communications and sonar (TJ, 0. The adaptive 
beamforming techniques are used in systems equipped with 
antenna arrays and usually have a trade-off between perfor- 
mance and computational complexity which depends on the 
designer's choice of the adaptation algorithm 0, Q, 0. The 
optimal linearly constrained minimum variance (LCMV) 
beamformer is designed in such a way that it attempts to 
minimize the array output power while maintaining a constant 
response in the direction of a signal of interest (Sol) JTJ, 0, 
0. However, this technique requires the computation of the 
inverse of the input data co variance matrix and the knowledge 
of the cross-correlation vector, rendering the method very 
complex for practical applications when the system is large. 
Adaptive versions of the LCMV beamformer were subse- 
quently reported with stochastic gradient (SG) 0, 0, 
and recursive least squares (RLS) 0, algorithms. 

These algorithms require estimates of the input data covari- 
ance matrix, which is a task that may become challenging 
in large systems and in highly dynamic situations such as 
those found in wireless communications and radar applica- 
tions. This is because the convergence speed and tracking 
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properties of adaptive filters depend on the number of sensor 
elements M and on the eigenvalue spread of the input data 
covariance matrix. Given this dependency on the number of 
sensor elements M, it is thus intuitive to reduce M while 
simultaneously extracting the key features of the original 
signal via an appropriate transformation. 

A cost-effective technique in short-data record scenarios 
and, in particular, with systems containing a large number 
of parameters is reduced-rank signal processing. The advan- 
tages are their superior convergence properties and enhanced 
tracking performance when compared with full-rank schemes 
operating with a large number of parameters, and their ability 
to exploit the low-rank nature of the signals encountered in 
beamforming applications. Several reduced-rank methods have 
been proposed to generate the signal subspace [3j-[17|. They 
range from computationally expensive eigen-decomposition 
techniques lfT0l - lfT2l to alternative approaches such as the 
auxiliary- vector filter (AVF) El, El, ED, the multistage 
Wiener filter (MSWF) El, El, El, ED which are based 
on the Krylov subspace, and joint optimization approaches 
ifTBTl , ||20l . Despite the improved convergence and tracking 
performance achieved with Krylov methods 1 13|- fl31 , |fT71 - 
|fl9ll they are relatively complex to implement and can suffer 
from numerical problems. The joint optimization techniques 
reported in [ 16 1, [20| outperform the eigen-decomposition- and 
Krylov-based methods and are amenable to efficient adaptive 
implementations. However, the design and analysis of adaptive 
LCMV reduced-rank algorithms based on joint optimization 
approaches have not been considered so far. 

This work proposes LCMV reduced-rank algorithms based 
on constrained joint iterative optimization of filters for 
antenna-array beamforming. The proposed scheme, whose 
initial results were reported in lETI . Il22l . jointly optimizes a 
projection matrix and a reduced-rank filter that operates at the 
output of the projection matrix. The essence of the proposed 
approach is to change the role of adaptive LCMV filters. The 
bank of adaptive filters is responsible for performing dimen- 
sionality reduction, whereas the reduced-rank filter effectively 
forms the beam in the direction of the Sol. We describe LCMV 
expressions for the design of the projection matrix and the 
reduced-rank filter and present SG and RLS algorithms for 
efficiently implementing the method. We also introduce an 
automatic rank estimation algorithm for determining the most 
adequate rank for the proposed algorithms. An analysis of 
the stability and the convergence properties of the proposed 
algorithms is presented and semi-analytical expressions are 
derived for predicting their performance. 

This paper is organized as follows. The system model 
is described in Section II. The full-rank and the reduced- 
rank LCMV filtering problems are formulated in Section III. 
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Section IV is dedicated to the proposed method, whereas 
Section V is devoted to the derivation of the adaptive SG and 
RLS algorithms and the rank adaptation technique. Section VI 
focuses on the analysis of the proposed algorithms. Section VII 
presents and discusses the simulation results and Section VIII 
gives the concluding remarks. 

II. System Model 

Let us consider a smart antenna system equipped with a 
uniform linear array (ULA) of M elements, as shown in Fig. 
1. Assuming that the sources are in the far field of the array, 
the signals of K narrowband sources impinge on the array 
(K < M) with unknown directions of arrival (DOA) 9i for 
1=1,2,, ..,K. 

The input data from the antenna array can be organized in 
an M x 1 vector expressed by 



where 



r{i) = A{9)s{i) + n{i) 



A{9) = [a(9 1 ),...,a(8 K )] 



(1) 



is the M x K matrix of signal steering vectors. The M X 1 
signal steering vector is defined as 

T 



am 



l,e 



-2nji 



3 -2irj(M-l)jf- cose, 



(2) 



for a signal impinging at angle 9i, I — 1, 2, . . . , K, where d s = 
A c /2 is the inter-element spacing, A c is the wavelength and 
(.) T denotes the transpose operation. The vector n(i) denotes 
the complex vector of sensor noise, which is assumed to be 
zero-mean and Gaussian with covariance matrix a 2 I. 

III. Problem Statement 

In this section, we formulate the problems of full-rank and 
reduced-rank LCMV filters. In order to perform beamforming 
with a full-rank LCMV filter, we linearly combine the data 



vector r(i) 

W = [W, Wn 



Ml 



with the full-rank filter 



J M\ 



to yield 

x(i) — w H r(i) 



(3) 



The optimal LCMV filter is the M x 1 vector w, which is 
designed to solve the following optimization problem 

minimize E[\w H r(i)\ 2 } = w H Rw 

subject to w H a{9k) = 1 

The solution to the problem in is given by Q, flU 



(4) 



Jo-pt 



a H {d k )R- 1 a{6 h )) 



(5) 



where a(9k) is the steering vector of the Sol, r(i) is the 
received data, the covariance matrix of r(i) is described by 
R = E[r(i)r H (i)], (•) denotes Hermitian transpose and E[-] 
stands for expected value. The filter w(i) can be estimated via 
SG or RLS algorithms 0. However, the laws that govern their 
convergence and tracking behaviors imply that they depend on 
M and on the eigenvalue spread of R. 

A reduced-rank algorithm must extract the most important 
features of the processed data by performing dimensionality 



reduction. This mapping is carried out by a M x D projection 
matrix on the received data as given by 



f (i) = Sgr(i) 



(6) 



where, in what follows, all Z?-dimensional quantities are 
denoted with a "bar". The resulting projected received vector 
f(i) is the input to a filter represented by the D vector 



[w 1 w 2 •■• w D ] ■ The filter output is 

x(i) — w H f(i) 



(7) 



In order to design the reduced-rank filter w we consider the 
following optimization problem 



minimize E\ \w r(i)\ I - w Rw 
subject to w H a(9k) = 1 
The solution to the above problem is 



w 



opt 



a H (9 k )R a{9 k ) 



(8) 



(9) 



where the reduced-rank covariance matrix is R = 
E[r(i)f H (i)] — S^RSd and the reduced-rank steering vec- 
tor is a(9k) = Spa(9k). The associated minimum variance 
(MV) for a LCMV filter with rank D is 



MV = 



a(9 k ) H S D (SZRS D )- 1 SZa( 



(10) 



The above development shows that the main problem is 
how to cost-effectively design Sd to perform dimensionality 
reduction on r(i), resulting in improved convergence and 
tracking performance over the full-rank filter. In the Appendix, 
we provide a necessary and sufficient condition for Sd to 
preserve the MV of optimal full-rank filter and discuss the 
existence of multiple solutions. In the following, we detail 
our proposed reduced-rank method. 

IV. Proposed Reduced-Rank Method 

In this section, we introduce the principles of the proposed 
reduced-rank scheme. The proposed scheme, depicted in Fig. 
2, employs a matrix Sd («) with dimensions MxDto perform 
dimensionality reduction on a data vector r(i) with dimensions 
M X 1. The reduced-rank filter w(i) with dimensions flxl 
processes the reduced-rank data vector f[i) in order to yield 
a scalar estimate x(i). The projection matrix Sjj(i) and the 
reduced-rank filter w(i) are jointly optimized in the proposed 
scheme according to the MV criterion subject to a constraint 
that ensures that the reduced-rank array response is equal to 
unity in the direction of the Sol. 

In order to describe the proposed method, let us first 
consider the structure of the M x D projection matrix 



S D (i) = [ Sl (i) | s 2 (i) | ... \s D (i)} 



(ID 



where the columns Sd(i) for d = 1, . . . , D constitute a bank 
of D full-rank filters with dimensions M x 1 as given by 

8d{i) = [si,d(i) S2,d{i) ■ ■ ■ SA/, d (i)] T 
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The output x(i) of the proposed reduced-rank scheme can be 
expressed as a function of the input vector r(i), the projection 
matrix Sd(i) and the reduced-rank filter w(i): 



x{i) = w H (i)S%{i)r(i) = w H {i)f{i) 



(12) 



It is interesting to note that for D = 1, the proposed scheme 
becomes a conventional full-rank LCMV filtering scheme with 
an addition weight parameter wr> that provides an amplitude 
gain. For D > 1, the signal processing tasks are changed and 
the full-rank LCMV filters compute a subspace projection and 
the reduced-rank filter provides a unity gain in the direction of 
the Sol. This rationale is fundamental to the exploitation of the 
low-rank nature of signals in typical beamforming scenarios. 

The LCMV expressions for the filters Sd(i) and w(i) can 
be computed via the proposed optimization problem 

minimize E[\w H (i)S%(i)r(i)\ 2 ] = w H (i)S%{i)RS D {i)w{i) 
subject to w H (i)Sp(i)a(O k ) = 1 

(13) 

In order to solve the above problem, we resort to the method 
of Lagrange multipliers [3] and transform the constrained 
optimization into an unconstrained one expressed by the 
Lagrangian 



strategy lies in the joint optimization of the filters. The rank D 
must be set by the designer to ensure appropriate performance 
or can be estimated via another algorithm. In the next section, 
we seek iterative solutions via adaptive algorithms for the 
design of Su(i) and w(i), and automatic rank adaptation 
algorithms. 

V. Adaptive Algorithms 

In this section we present adaptive SG and RLS versions 
of the proposed scheme for efficient implementation. We also 
consider the important issue of automatically determining the 
rank of the scheme via the proposal of an adaptation technique. 
We then provide the computational complexity in arithmetic 
operations of the proposed reduced-rank algorithms. 

A. Stochastic Gradient Algorithm 

In this part, we present a low-complexity SG adaptive 
reduced-rank algorithm for efficient implementation of the 
proposed method. These algorithms were reported in ETI . (l22ll 
and are reproduced here for convenience. By computing the 
instantaneous gradient terms of (fl4l i with respect to Sp(i) and 
w*(i), we get 



C(S D (i),w(i)) = E[\w H (i)S%(i)r(i)f 



2n[X(w H (i)S^(i)a(Ef M Wp^ = S^MO^W + 2A*a(0 fe )w H (i) 
(14) 



MVw*(i) 



= x*(i)SZ(i)T(i) + 2\*S%(i) a (0 k ) 



(18) 



where A is a scalar Lagrange multiplier, * denotes complex 
conjugate and the operator 5t[-] selects the real part of the 
argument. By fixing w(i), minimizing (fl4l with respect to 
Su(i) and solving for A, we get 



By introducing the positive step sizes fi s and using the 
gradient rules Sd(z+1) = <Sx>(i) — A*sV£mvs* (i) &ndw(i + 
1) = w(i) — fi w \7£MVw*(i)> enforcing the constraint and 
solving the resulting equations, we obtain 



S D (i) 



H -1 o( 



<k)w 



H 



w H (i)R ijj w(i)a H ( 
E[r{i)r H {i)\ and Ra 



(15) 



where R = E[r(i)r n {%)) and R a = E[w(i)w H (i)}. By 
fixing So(i), minimizing (fl4l with respect to w(i) and 
solving for A, we arrive at the expression 



w(i) 



R {i)a{e k ) 
a ff (0 fe ) J R~ 1 Wa(0 fe ) : 



where R(i) = E{S%(i)r(i)r H {i)S D (i)} = 
a(e k ) = S"(i)a(9 k ). The associated MV is 

1 



MV = 



a 



Hi 



(16) 



E[f(i)f H {i)}, 



(17) 



h)R x (i)a{9 k ) 

Note that the filter expressions in (fl5l l and (fTol l are not closed- 
form solutions for w(i) and Su{i) since ( fl5l ) is a function of 
w(i) and ( fTo*b depends on So{i)- Thus, it is necessary to 
iterate ( fl5l l and ( fTol l with initial values to obtain a solution. 
An analysis of the optimization problem in ( TT3l is given in 
Appendix II. Unlike existing approaches based on the MSWF 
Ipm and the AVF |fl9l methods, the proposed scheme provides 
an iterative exchange of information between the reduced-rank 
filter and the projection matrix and leads to a much simpler 
adaptive implementation. The projection matrix reduces the 
dimension of the input data, whereas the reduced-rank filter 
yields a unity response in the direction of the Sol. The key 



S D (i+l) = S D {i)-^ s x^i)[r(i)w H (i)~(a H (0 k )a(6 k )) \{9 k )w H (^ 

(19) 

w(i+l) = w{i)-v w x*{i)[l-(a H {9 k )a(9 k )) 1 a(9 k )a H (9 k )]f(i), 

(20) 

where x(i) = w H ^(i)iS^(i)r(i). The proposed scheme trades- 
off a full-rank filter against one projection matrix Sn(i) and 
one reduced-rank adaptive filter w(i) operating simultaneously 
and exchanging information. 

B. Recursive Least Squares Algorithms 

Here we derive an RLS adaptive reduced-rank algorithm for 
efficient implementation of the proposed method. To this end, 
let us first consider the Lagrangian 



C hS (S D (i), ©(*)) = Yl « <_, |* H (0^(i)»-(0r + 2^[X(w H (z)S^(i)a 

(21) 



i=i 



where a is the forgetting factor chosen as a positive constant 
close to, but less than 1. 

Fixing w(i), computing the gradient of (Bil l with respect to 
Sz>(i), equating the gradient to a null vector and solving for 
A, we obtain 



S D (i) 



R^^)a(9 k )w H m^(i) 
w H {i)Rl 1 {i)w{i)a"{9 k )R- 1 {i)a{ 



(22) 
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where R(i) = Yl\=i ot l ~ l r(l)r H (I) is the input covariance 
matrix, and Ra>(i) — w(i)w H (i) is the reduced-rank weight 
matrix at time instant i. The computation of ( 1221 includes the 
inversion of R(i) and R lTl (i), which may increase significantly 
the complexity and create numerical problems. However, the 
expression in ( 1221 can be further simplified using the constraint 
w H (i)SD(i)a(O k ) = 1. The details of the derivation of the 
proposed RLS algorithms and the simplification are given in 
Appendix III. The simplified expression for Sd^) is given by 

P(i)a(6 k )d H (8 k ) 



S D (j) 



a H {6 k )P(i)a{6 k ) 



(23) 



where we defined the inverse covariance matrix P(i) = 
for convenience of presentation. Employing the matrix 
inversion lemma 131, we obtain 



k(i) 



a- x P(i - l)r(i) 
l + or l r H (i)P{i - l)r(i) 



(24) 



P(i) 



L P(z-l) 



l k(i)r H (i)P(i - 1) (25) 



where k(i) is the M X 1 Kalman gain vector. We set P(0) = 
SI m to start the recursion of (l25l . where 8 is a positive 
constant and I m is an M x M identity matrix. 

Assuming So{i) is known and taking the gradient of (fJTJ 
with respect to w(i), equating the terms to a null vector and 
solving for A, we obtain the D x 1 reduced-rank filter 



w(i) ~ 



P(i)a(g fc ) 
a H (8 k )P(i)a(8 k ) 



(26) 



where P(i) = R \i) and R(i) = Y!i=i a ^ lf ( l ) fH { 1 ) is 
the reduced-rank input covariance matrix. In order to estimate 
P(i), we use the matrix inversion lemma [3] as follows 

or x P{i - l)r{i) 



k{i) 



- l f H (i)P{i-l)f(i) 



(27) 



P(i) 



l P(i - 1) - oT x k{i)f H (i)P(i - 1) (28) 



where k(i) is the D xl reduced-rank gain vector and P(i) — 
R (i) is referred to as the reduced-rank inverse covariance 
matrix. Hence, the covariance matrix inversion R (i) is 
replaced at each step by the recursive processes (|27j and (|28l > 
for reducing the complexity. The recursion of (l28~t is initialized 
by choosing P(0) = 51 d, where 5 is a positive constant and 
Id is a D x D identity matrix. 

The proposed RLS algorithm trade-off a full-rank filter with 
M coefficients against one projection matrix S'_d(i), given in 
(I23l-(l25]l and one D x 1 reduced-rank adaptive filter w(i), 
given in (f26b-(f28]). operating simultaneously and exchanging 
information. 



(as we will see later) then the additional complexity can be 
acceptable provided the gains in performance justify them. 
In the case of the proposed reduced-rank RLS algorithm the 
complexity is quadratic with M 2 and D 2 . This corresponds 
to a complexity slightly higher than the one observed for the 
full-rank RLS algorithm, provided D is significantly smaller 
than M, and comparable to the cost of the MSWF-RLS H3 
and the AVF lfl9l 

In order to illustrate the main trends in what concerns 
the complexity of the proposed and analyzed algorithms, we 
show in Fig. 3 the complexity in terms of additions and 
multiplications versus the number of input samples M. The 
curves indicate that the proposed reduced-rank RLS algorithm 
has a complexity lower than the MSWF-RLS algorithm |[T7l 
and the AVF [19], whereas it remains at the same level of 
the full-rank RLS algorithm. The proposed reduced-rank SG 
algorithm has a complexity that is situated between the full- 
rank RLS and the full-rank SG algorithms. 



= D. Automatic Rank Selection 



The performance of the algorithms described in the previ- 
ous subsections depends on the rank D. This motivates the 
development of methods to automatically adjust D on the 
basis of the cost function. Unlike prior methods for rank 
selection which utilize MSWF-based algorithms ifTTl or AVF- 
based recursions 11191 . we focus on an approach that jointly 
determines D based on the LS criterion computed by the filters 
So{i) and Wn(i), where the subscript D denotes the rank 
used for the adaptation. In particular, we present a method for 
automatically selecting the ranks of the algorithms based on 
the exponentially weighted a posteriori least-squares type cost 
function described by 



w»(i-l)S D (i-l)r(l)\ 2 , 



C(S D (i-l),w D (i-l)) =J2 ai ~ l 

i=i 

(29) 

where a is the forgetting factor and wu(i — 1) is the reduced- 
rank filter with rank D. For each time interval i, we can select 
the rank D opt which minimizes C(So{i — 1), Wd{i — 1)) and 
the exponential weighting factor a is required as the optimal 
rank varies as a function of the data record. The key quantities 
to be updated are the projection matrix the reduced- 

rank filter wi>(i), the associated reduced-rank steering vector 
d(9 k ) and the inverse of the reduced-rank covariance matrix 
P(i) (for the proposed RLS algorithm). To this end, we 
define the following extended projection matrix So(i) and the 
extended reduced-rank filter weight vector W£>(i) as follows: 



C. Complexity of Proposed Algorithms 

Here, we evaluate the computational complexity of the 
proposed and analyzed LCMV algorithms. The complexity 
expressed in terms of additions and multiplications is depicted 
in Table I. We can verify that the proposed reduced-rank SG 
algorithm has a complexity that grows linearly with DAI, 
which is about D times higher than the full-rank SG algorithm 
and significantly lower than the MSWF-SG IfTTl. If D « M 



S D (i) 



SlA Si 2 



SM,1 Sm,2 



S 1,D„ 



SAI,D„ 



The extended projection matrix 
reduced-rank filter weight vector 



S D {i) 
w D (i) 



s i.A, 



sai,d„ 



and W]j(i) 



(30) 

and the extended 
are updated along 
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with the associated quantities a (6k) and P(i) (only for the 
RLS) for the maximum allowed rank £> max and then the 
proposed rank adaptation algorithm determines the rank that 
is best for each time instant i using the cost function in 
The proposed rank adaptation algorithm is then given by 



D opt = arg min 

D min <d<r> n 



C(S D (i-l),w D (i-l)) (31) 



where d is an integer, D n 
maximum ranks allowed for the reduced-rank filter, respec- 
tively. Note that a smaller rank may provide faster adaptation 
during the initial stages of the estimation procedure and a 
greater rank usually yields a better steady-state performance. 
Our studies reveal that the range for which the rank D 
of the proposed algorithms have a positive impact on the 
performance of the algorithms is limited, being from D m [ n = 3 
to Dmax = 8 for the reduced-rank filter recursions. These 
values are rather insensitive to the system load (number of 
users), to the number of array elements and work very well 
for all scenarios and algorithms examined. The additional 
complexity of the proposed rank adaptation algorithm is that 
it requires the update of all involved quantities with the 
maximum allowed rank D max and the computation of the cost 
function in (l29l l. This procedure can significantly improve the 
convergence performance and can be relaxed (the rank can be 
made fixed) once the algorithm reaches steady state. Choosing 
an inadequate rank for adaptation may lead to performance 
degradation, which gradually increases as the adaptation rank 
deviates from the optimal rank. A mechanism for automati- 
cally adjusting D m i n and Z? max based on a figure of merit 
and the processed data would be an important technique to be 
investigated. For example, this mechanism could in principle 
adjust D m i n and D max in order to address the needs of the 
model and the performance requirements. This remains a topic 
for future investigation. 

One can also argue that the proposed rank adaptation may 
not be universally applied to signal processing problems, even 
though it has been proven highly effective to the problems 
we dealt with. Another possibility for rank adaptation is the 
use of the cross-validation (CV) method reported in [19|. 
This approach selects the lengths of the filters that minimize 
a cost function that is estimated on the basis of data that 
have not been used in the process of building the filters 
themselves. This approach based on the concept of "leave one 
out" can be used to determine the rank without requiring any 
prior knowledge or the setting of a range of values |fl9l . A 
drawback of this method is that it may significantly increase 
the length of the filters, resulting in higher complexity. Other 
possible approaches for rank selection may rely on some prior 
knowledge about the environment and the system for inferring 
the required rank for operation. The development of cost- 
effective methods for rank selection remains an interesting area 
for investigation. 

VI. Analysis of Algorithms 

In this section, we present the stability and the MSE conver- 
gence analyses of the proposed SG algorithms. Specifically, we 
consider the joint optimization approach and derive conditions 



of stability for the proposed SG algorithms. We then assume 
that the algorithms will converge and carry out the MSE 
convergence analysis in order to semi-analytically determine 
the MSE upon convergence. The RLS algorithms are expected 
to converge to the optimal LCMV filter and this has been 
verified in our studies. A discussion on the preservation of the 
MV performance, the existence of multiple solutions and an 
analysis of the optimization of the proposed scheme valid for 
both SG and RLS algorithms is included in the Appendices I 
and H. 



A. Stability Analysis 

In order to establish conditions for the stability of the 
proposed SG algorithms, we define the error matrices at time 

i as 

es D (i) = S D (i) - S D , opt 



and 



,(i) = w(i) 



''opt: 



where w opt and So. opt are the optimal parameter estimators. 
Since we are dealing with a joint optimization procedure, 
both filters have to be considered jointly. By substituting the 
expressions of eg D (i) and e^(i) in ( fT9] > and (l20l i. respectively, 
and rearranging the terms we obtain 

e SD (i + 1) = {I - fi.[I- (a H (e k )a(e k ))- 1 a(6 k )a H (e k )]r(i)r H (i)}e t 

- f x s [I-(a H (e k )a(e k ))- 1 a(e k )a H (e k )]r^)w H (i)r H (i), 

+ n B [I - (a H (9 k )a(e k ))- 1 a(e k )a H (6 k )}r(i)r H (t)[S D (t) 

(32) 

e w (i + 1) = {/ — /UI " (d H (9 k )d(e k ))- 1 d(e k )d H (e k )}r(t)r H (i)}e u 

- fi w [I - (d H (6 k )d(9 k ))- 1 d(9 k )a H (9 k )]f({)r H (i)es D (i) 
+ IMu[I- (d H (9 k )d(9 k ))- 1 d(9 k )a H (9 k ))S^]r(i)f H (i)t 

(33) 

Taking expectations and simplifying the terms, we obtain 



E[e SD (i+l)} 
E[en,(i + 1)] 



E[e So (i)} 
E[e a (i)] 



(34) 



where 
P = 



{I (a H (9 k )a(e k ))- 1 a(e k ) a H (9 k )]r(i)r H (i)} 
-fi w [I - (a H (9 k )a(6 k ))- 1 a(9 k )a H (9 k )]r(i)r H (i) 



-/Is [J 

{ J - fl w [I 



- (a H (e k )a(9 k ))- 1 a(e k )a H (e k )]r(i)r H (i)[S D (i)(I - w opt w H 
(d H (e k )a(6 k ))- 1 d(9 k )d H (e k ))SE(i)}r(i)r H (i)(SD(i)(I - v 



The previous equations imply that the stability of the algo- 
rithms depends on the spectral radius of P. For convergence, 
the step sizes should be chosen such the eigenvalues of P H P 
are less than one. Unlike the stability analysis of most adaptive 
algorithms y], in the proposed approach the terms are more 
involved and depend on each other as evidenced by the 
equations in P and T. 
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B. MSE Convergence Analysis 

Let us consider in this part an analysis of the MSE in steady 
state. This follows the general steps of the MSE convergence 
analysis of [ 3 ] even though novel elements will be introduced 
in the proposed framework. These novel elements in the 
analysis are the joint optimization of the two adaptive filters 
w(i) and Sn(i) of the proposed scheme and a strategy to 
incorporate the effect of the step size of the recursions in (|T9l > 
and (EQb- 

Let us define the MSE at time i + 1 using the relations 



e~w{i + 1) = w(i + 1) - w 



opt 



<& H R £w Rewriting d38l in terms of the above trans- 
formed quantities we have: 

£(*) = tr E[A$ H R W $>] 

= trm n + tr[E[e w (i)]a H (9 k ) + a(9 k )E[e£(i)} (39) 
+ Afls«(i)] 

Since lim^oo E[e w (i)\ = 0, then lim^oo £(£) = £ min + 
tr[ARe w ]. Thus, it is evident that to assess the evolution of 
it is sufficient to study R^ w {i). 
Using es D (i) and e-g,{i) and combining them to compute 
e w (i), we get 



and 



=w(i) 



J opt 



= E[w H (i)r(i)r(i)w(i)], 



where the filter w(i) = Sr)(i)w(i) with M coefficients is the 
D-rank approximation of a full-rank filter obtained with an 
inverse mapping performed by S d(*)- 

The MSE of the proposed scheme can be expressed by: 



= - S Dt optt«opt (40) 

= es D (i)e i ,(j) + SD,o P tew{i) + es D {i)w opt 

Substituting the expressions for es D (i + 1) and e~w{i + 1) in 
and (1331 . respectively, to compute e w (i + 1), we get 



,(< + !) 



MSE(i) = E[\d{i) - w H (i)r(i)\ 2 ] 

= e min + f (t) - Uin - E[eZ(i)]a(6 k ) - a H (9 k )E[e v ^^ ] . 

= e mm + £ ex (i) - E[eg{i)]a{d k ) - a H (6 k )E[e w (i)] 

(35) 

where d(i) corresponds to the desired signal, £(£) = 
E[w H (i)r(i)r H (i)w(i)}, e rnm = E[\d(i) -w^ pt r(i)\ 2 } is the 
MSE with 



: e w (i) - fi w x*(i)S D (i)r p (i) - fi s x*(i)S rp (i)w(i) 

{i)w opt 

(41) 



= w H {i)S%(i)r(i) = w H {i)r{i) 
(I - (a H (9 k )a(e k ))- 1 a(6 k )a H (e k ))r(i)w H (i) 



J opt 



£,min ^ & ( 



(36) 



where £ m i„ = 1/ (a H (9 k )R~ 1 a{9 k )) is the minimum 
variance, and £ ex (i) — — ^„ m is the excess MSE 

due to the adaptation process at the time instant i. Since 
lim^oo E[e w (i)} = we have 



lim MSE(i) 



lim £ex(i) 



(37) 



where the £ ex (oo) term in ( |37T i is the steady-state excess MSE 
resulting from the adaptation process. The main difference 
here from prior work lies in the fact that this refers to the 
excess MSE produced by a Z?-rank approximation filter w(i). 
In order to analyze the trajectory of let us rewrite it as 



= E[w H {i)r{i)r H (i)w(i)] 

= E[w H (i)Sl(i)r(i)r H (i)S D (i)w(i)] 

= tr E[R w {i)R] 



(38) 



.H 



where R w (i) = E[w(i)w H (i)} = w opt w' opt 
E[e w (i)]w^ pt + w opt E[eg(i)] + R &w (<) 0. 

To proceed with the analysis, we must define the quantities 
R — &A& H , where the columns of $ are the eigenvectors 
of the symmetric and positive semi-definite matrix R and 
A is the diagonal matrix of the corresponding eigenval- 
ues, R Bvj (i) = E[e w (i)e^(i)], the rotated tap error vector 
&w(i) — * e t«(0' me routed signal vectors r(i) = <& H r(i), 
a(9 k ) = <S> H a{9 k ) and R~ ew (i) = E[e w {i)e^{i)) = 



f p (i) = (i-(s D (i)a H (9 k )s^(i)a(9 k ))- 1 s D (i)a(e k )a H (e k )sZ{i)s D 

We can further rewrite the expressions above in order to obtain 
a more compact and convenient representation as 

e w (i + 1) = (J- A)e w (i) + BC + fi s fi w (x*(i)) 2 S rp (i)f p (i) + e Sr> {i) 

(42) 

where 

A = fi w S D (i)f p (i)r H (i) + fi s S rp (i)w(i)r H (i) - S D ,o P t 
B = -fi w S D (i)f p (i)r H (i) - ^t s S rp {i)w{i)r H (i) 
C = es D (i)w pt + SD,opte-w(i) + e SD (i)w opt . 

Now, we need to compute R £w (i + 1) = E[e w (i+l)e^,(i + 
1)] by using the result in d42l . which yields 

R ew {i + l) = (I - A)R ew (i)(I - A) H + {I - A)e w (i)C H B H 
+ w w (x(i)) 2 (I - A)e w (i)(rZ(i)S? p (i)) 
+ A)e w (i)w^ t S^ opt + BCeZmi - A) H 
+ BCC H B H + ^ s ^ w {x{i)) 2 BCf^{i)S^ p {i) 

•'optZSn 



BCw^e^^(i) + ^ w (x*(t)) 2 S rp (i)r p (i)eg(i)(I 



H A H 



+ HstJ-w(x* (i)) S rp (i)f p (i)C A 
+ (fi sf i w ) 2 \x(t)\ 4 S rp (i)r P (i)*f (i)S r , (}) 
+ n s ti w (x(i)) 2 es D (i)w opt r p (i)S rp (i) 



- e So (i)w opt e^(i)(I - A) 
+ e SD (i)woptW^ pt e% D (i) 



H 



H r,H 



es D (i)w opt C" B 
(43) 
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Since E[e w (i)] = and E[es D (i)] = 0, we can simplify the 
previous expression and obtain 

R ew (i + 1) = (I - A)R ew (i)(J - A) H 

+ BCC H B H + ^ s ^ w {x{i)) 2 BCr^{i)S^ p {i) 
+ ^ w (x*(i)) 2 S rv {i)f p {i)C H A H 
+ ( Psf i w ) 2 \x(i)\ 4 S rp (i)r p (i)r% (i)S rp (*) 
+ e SD (i)w opt wZ pt e% D (i) 

(44) 



Solving for R £w , the MSE can be computed by 

MSE(z + 1) = e mm + tr[AR~ ew (%)] 

= e mm + tr[K®R ew (i)$ H ] 



(45) 



It should be remarked that the expression for R &111 (i) is quite 
involved and requires a semi-analytical approach with the aid 
of computer simulations for its computation. This is because 
the terms resulting from the joint adaptation create numerous 
extra terms in the expression of R Bw (i), which are very 
difficult to isolate. We found that using computer simulations 
to pre-compute the terms of R e ^ (i) as a function of the step 
sizes was more practical and resulted in good match between 
the semi-analytical and simulated curves. In the following 
section, we will demonstrate that it is able to predict the 
performance of the proposed SG algorithm. 

VII. Simulations 

In this section we evaluate the performance of the proposed 
and the analyzed beamforming algorithms via computer sim- 
ulations. We also verify the validity of the MSE convergence 
analysis of the previous section. A smart antenna system with a 
ULA containing M sensor elements is considered for assessing 
the beamforming algorithms. In particular, the performance of 
the proposed scheme and SG and RLS algorithms is compared 
with existing techniques, namely, the full-rank LCMV-SG |4| 
and LCMV-RLS (9), and the reduced-rank algorithms with 
S D (i) designed according to the MSWF 021, the AVF [19] 
and the optimal linear beamformer that assumes the knowledge 
of the covariance matrix fZ). In particular, the algorithms are 
compared in terms of the mean-squared error (MSE) and 
the signal-to-interference-plus-noise ratio (SINR), which is 
defined for the reduced-rank schemes as 



SINR(i) 



w H (i)S%(i)R s S D (i)w(i) 
w H (i)S%(i)R x S D (i)il>(iY 



(46) 



where R s is the autocorrelation matrix of the desired signal 
and Rj is the cross-correlation matrix of the interference and 
noise in the environment. Note that for the full-rank schemes 
the SINR(i) assumes S£)(i) — Im, where lyi is an identity 
matrix with dimensionality M. For each scenario, 200 runs 
are used to obtain the curves. In all simulations, the desired 
signal power is a 2 d — 1, and the signal-to-noise ratio (SNR) 
is defined as SNR = 2§. The filters are initialized as w(0) = 

[10 ... 0] and S D (0) = [In °dx(m-d)]> where °dxm-d 
is a D x (M — D) matrix with zeros in all experiments. 



A. MSE Analytical Performance 

In this part of the section, we verify that the results in (l43l 
and d45l > of the section on MSE convergence analysis of the 
proposed reduced-rank SG algorithms can provide a means 
of estimating the MSE upon convergence. The steady state 
MSE between the desired and the estimated symbol obtained 
through simulation is compared with the steady state MSE 
computed via the expressions derived in Section VI. In order 
to illustrate the usefulness of our analysis we have carried 
out some experiments. To semi-analytically compute the MSE 
for the SG recursion, we have used ((36) and assumed the 
knowledge of the data covariance matrix R. We consider 5 
interferers (K = 6 users in total - the Sol and the interferers) 
at -60°, -30°, 0°, 45°, 60° with powers following a log- 
normal distribution with associated standard deviation 3 dB 
around the Sol's power level, which impinges on the array at 
15°. 

We compare the results obtained via simulations with those 
obtained by the semi-analytical approach presented in Section 
VI. In particular, we consider two sets of parameters in order 
to check the validity of our approach. One of the sets has 
larger step sizes (/i s = 0.0025 and /j, w = 0.01), whereas 
the other set employs smaller step sizes ( fi s = 0.001 and 
H w — 0.001) for the recursions. The results shown in Fig. 
4 indicate that the curves obtained with the semi-analytical 
approach agrees with those obtained via simulations for both 
sets of parameters, verifying the validity of our analysis. Note 
that the algorithms with smaller step sizes converge slower 
than the algorithms equipped with larger step sizes. However, 
the proposed algorithms with smaller step sizes converge to 
the same level of MSE as the optimal LCMV, whereas the 
proposed algorithms with larger step sizes exhibit a higher 
level of misadjustment. In what follows, we will consider the 
convergence rate of the proposed reduced-rank algorithms in 
comparison with existing algorithms. 

B. SINR Performance 

In the first two experiments, we consider 7 interferers at 
-60°, -45°, -30°, -15°, 0°, 45°, 60° with powers following 
a log-normal distribution with associated standard deviation 3 
dB around the Sol's power level. The Sol impinges on the 
array at 30°. The parameters of the algorithms are optimized. 

We first evaluate the SINR performance of the analyzed 
algorithms against the rank D using optimized parameters (/x s , 
fi w and forgetting factors A) for all schemes and N = 250 
snapshots. The results in Fig. 5 indicate that the best rank 
for the proposed scheme is D — 4 (which will be used in 
the second scenario) and it is very close to the optimal full- 
rank LCMV filter. Our studies with systems with different 
sizes show that D is relatively invariant to the system size, 
which brings considerable computational savings. In practice, 
the rank D can be adapted in order to obtain fast convergence 
and ensure good steady-state performance and tracking after 
convergence. 

We show another scenario in Fig. 6 where the adaptive 
LCMV filters are set to converge to the same level of SINR. 
The parameters used to obtain these curves are also shown. 
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The SG version of the MSWF is known to have problems in 
these situations since it does not tridiagonalize its covariance 
matrix [17], being unable to approach the optimal LCMV. The 
curves show an excellent performance for the proposed scheme 
which converges much faster than the full-rank-SG algorithm, 
and is also better than the more complex MSWF-RLS and 
AVF schemes. 

In the next experiment, we consider the design of the 
proposed adaptive reduced-rank LCMV algorithms equipped 
with the automatic rank selection method described in Section 
V.D. We consider 5 interferers at -60°, -30°, 0°, 45°, 60° 
with equal powers to the Sol, which impinges on the array 
at 15°. Specifically, we evaluate the proposed rank selection 
algorithms against the use of fixed ranks, namely, D = 3 and 
D = 8 for both SG and RLS algorithms. The results show that 
the proposed automatic rank selection method is capable of 
ensuring an excellent trade-off between convergence speed and 
steady-state performance, as illustrated in Fig [7] In particular, 
the proposed algorithm can achieve a significantly faster 
convergence performance than the scheme with fixed rank 
D = 8, whereas it attains the same steady state performance. 

In the last experiment, we consider a non-stationary scenario 
where the system has 6 users with equal power and the 
environment experiences a sudden change at time i = 800. 
The 5 interferers impinge on the ULA at —60°, —30°, 0°, 
45°, 60° with equal powers to the Sol, which impinges on the 
array at 15°. At time instant i — 800 we have 3 interferers 
with 5 dB above the Sol's power level entering the system with 
DoAs —45°, —15° and 30°, whereas one interferer with DoA 
45° and a power level equal to the Sol exits the system. The 
proposed and analyzed adaptive beamforming algorithms are 
equipped with automatic rank adaptation techniques and have 
to adjust their parameters in order to suppress the interferers. 
We optimize the step sizes and the forgetting factors of all the 
algorithms in order to ensure that they converge as fast as they 
can to the same value of SINR. The results of this experiment 
are depicted in Fig. [8] The curves show that the proposed 
reduced-rank algorithms have a superior performance to the 
existing algorithms. 

VIII. Conclusions 

We proposed reduced-rank LCMV beamforming algorithms 
based on joint iterative optimization of filters. The proposed 
reduced-rank scheme is based on a constrained joint iterative 
optimization of filters according to the minimum variance 
criterion. We derived LCMV expressions for the design of the 
projection matrix and the reduced-rank filter and developed 
SG and RLS adaptive algorithms for their efficient imple- 
mentation along with an automatic rank selection technique. 
An analysis of the stability and the convergence properties 
of the proposed algorithms was presented and semi-analytical 
expressions were derived for predicting the MSE performance. 
The numerical results for a digital beamforming application 
with a ULA showed that the proposed scheme and algorithms 
outperform in convergence and tracking the existing full-rank 
and reduced-rank algorithms at comparable complexity. The 
proposed algorithms can be extended to other array geometries 
and applications . 



Appendix 

In this Appendix we discuss the conditions for which the 
MV obtained for the full-rank filter is preserved and the 
existence of multiple solutions in the proposed optimization 
method. Given an M x D projection matrix So(i), where 
D < M, the MV is achieved if and only if w which 
minimizes (0]l belongs to the Range{S : £)(i)}, i.e. w(i) lies 
in the subspace generated by Sd^)- In this case, we have 

MV(te(i)) = (a H (d k )R- 1 a(6 k ))- 1 . (47) 

For a general we have 

MV(t»(i)) > (a H (6 k )R- 1 a(e k )y 1 . (48) 

From the above relations, we can conclude that there exists 
multiple solutions to the proposed optimization problem. 

In this appendix, we carry out an analysis of the proposed 
reduced-rank method and its optimization. Our approach is 
based on expressing the output of the proposed scheme and the 
proposed constraint in a convenient form that renders itself to 
analysis. Let us rewrite the proposed constrained optimization 
method in (fLTt using the method of Lagrange multipliers and 
express it by the Lagrangian 

C = E[\w H \i)S%(i)r(i)\ 2 ] + 2K[\(w H (i)S%(i)a{9 k ) - 1)] 

(49) 

In order to proceed, let us express x{i) in an alternative and 
more convenient form as 

x(i) = w H (i)S%(f)r(f) = w H (i) J2 $(i)r{i)q d 

d=l 





' r(i) ... 





T 


- sta) - 


w H (i) 


r(i) ... 











... 


r(i) _ 







w H (i)^t T (i)s* v {i) 



(50) 



where St(i) is a DM x D block diagonal matrix with the input 
data vector r(i), q d is a D x 1 vector with a 1 in the d-th 
position and s*(i) is a DM x 1 vector with the columns of 
So(i) stacked on top of each other. 

In order to analyze the proposed joint optimization proce- 
dure, we can rearrange the terms in x(i) and define a single 
D(M + 1) x 1 parameter vector f(i) = [w T (i) s^(i)] T . We 
can therefore further express x(i) as 



x(i) = f H (i) 



OdxD Odxdm 
9t(i) Odm x DM 



(51) 



where G(i) is a D(M + 1) x D(M + 1) matrix which contains 
Now let us perform a similar linear algebra transforma- 
tion with the proposed constraint w H (i)S^,(i)a(0k) = 1 and 
express it as 

w H (i)S%(i)a(8 k ) = f H (i)A(e k )f(i) (52) 
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where the D(M + 1) x D(M + 1) matrix A(9 k ) is structured 
as 

Odxd Odxdm 

3^a(9 fe ) ®DMxDM 

and the DM x D block diagonal matrix 5J a (g fc )(i) with the 
steering vector a(9 k ) constructed as 



A(9 k ) 



Mr 



a(0 fc ) ... 
a(0 fe ) ... 







a(fl fc ) 



multi-dimensional surface. This remains as an interesting open 
problem. 

In this appendix, we detail the derivation of the filter 
Su(i) and the simplification shown in (f23l > for reducing the 
computational complexity. Let us consider the derivation of 
Su(i) obtained from the minimization of the Lagrangian 

i 

£(5 I? W,t7;( l )) = ^a^|t7; ff (z)5g( l )r(0| 2 +23?[A(^( l )SgWa(^ 



(53) 



At this point, we can alternatively express the Lagrangian in 
(ED as 

C = E[\f H (i)G(i)f(i)\ 2 ] + 2K[\tf H (i)A{9 k )f(i) - 1)]. 

(54) 

We can examine the convexity of the above Lagrangian by 
computing the Hessian (Jf)wifh respect to f(i) using the 
expression |23l 

„ g d(C) 

H -WW)m) (55) 

and testing if the terms are positive semi-definite. Specifically, 
H is positive semi-definite if v H Hv > for all nonzero v 6 
c d(m+i)xD(m+i) | 24 | xhere f ore5 the optimization problem 

is convex if the Hessian H is positive semi-definite. 

Evaluating the partial differentiation in the expression given 
in (|55| | yields 

H = E[f H (i)G(i)f(i)G(i) + G(i)f{i)f H {i)G(i) 

+ G{i)f H (i)G(i)f(i) + f H (i)G{i)G{i)f{i) + 2\A{9 k 

(56) 

By examining H, we verify that the second and fourth terms 
are positive semi-definite, whereas the first and the third terms 
are indefinite. The fifth term depends on the constraint, which 
is typically positive in the proposed scheme as verified in our 
studies, yielding a positive semi-definite matrix. Therefore, 
the optimization problem can not be classified as convex. It 
is however important to remark that our studies indicate that 
there are no local minima and there exists multiple solutions 
(which are possibly identical). 

In order to support this claim, we have checked the impact 
on the proposed algorithms of different initializations . This 
study confirmed that the algorithms are not subject to perfor- 
mance degradation due to the initialization although we have to 
bear in mind that the initialization Sd(0) = Om-xd annihilates 
the signal and must be avoided. We have also studied a par- 
ticular case of the proposed scheme when M = 1 and D = 1, 
which yields the Lagrangian C(w,Sd) = E[\wSDr\ 2 ] + 
2$t[\(wSDa{9k) — 1)] ■ Choosing S& (the "scalar" projection) 
fixed with D equal to 1, it is evident that the resulting function 
C(w,S D = l,r) = \w* rf + 23i[\(wa(0 k ) - 1)] is a 
convex one. In contrast to that, for a time-varying projection 
Sd the plots of the function indicate that the function is no 
longer convex but it also does not exhibit local minima. This 
problem can be generalized to the vector case, however, we 
can no longer verify the existence of local minima due to the 



(57) 

Taking the gradient terms of the above expression with respect 
to S* D (i), we get 



VC(S D (i),w(i)) s 



!,(*) 



E 

1=1 



a l - l r(l)r H {l)S D (i)w{i)w H (<) + 2Xa( 



= R^So^Raii) + 2\a{9 k )w H (i). 

(58) 

Making the above gradient terms equal to zero yields 

S D (i) = i?- 1 ( l )(-2A)a(0 fc )^ ff ( l ) J R,: 1 . (59) 

Using the proposed constraint w H (i) S^^a^) = 1 
and substituting the above filter expression, 
we obtain the Lagrange multiplier A = 
-l/2(w H (i)R^ 1 w(i)a H (9 k )R~ 1 (i)a(9 k ))- 1 . Substituting 
A into ( |59l , we get 



S D (i) = 



R- l (i)a(9 k )w H (i)R a \i 



(60) 



(61) 



w H (i)R lD 1 (t)w(t)aH(9 k )R- 1 (i)a(9 k ) 

The above expression for the matrix filter Sjj(i) can be 
-.simplified by observing the quantities involved and making 
-rise of the proposed constraint w H (i)Sp(i)a(9 k ) = 1. Let us 
consider the term w H (i)R lTl w(i) in the denominator of (f60l > 
and multiply it by the proposed constraint as follows: 

w H {i)R^w(i) = w H (i)R^w(i)w H (i)S%(i)a(9 k ) 
= w H (i)S%(i)a(6 k ) = 1. 

Now let us consider the term a H [9 k )w H (ijR^ 1 (i) and 
rewrite it as follows: 

a{9 k )w H (i)R^(i) = a{9 k )w H (i)R^\i)w H {i)S%{i)a{9 k ) 

= a(9 k )a H {9 k )S D (i)w{i)w H (i)lQ\i) 

= a(9 k )a H {9 k )S D (i) = a{9 k )a H {9 k ). 

(62) 

Using the relations obtained in doTT i and (l62l into the expres- 
sion in ( f60b . we can get a simpler expression for the projection 
matrix as given by 



S D (i) = 



fl- 1 ( t )a(0 fc )w g (i)R a 1 (z) = R- 1 (i)a(9 k ) 

w H { l )R- 1 {i)w{ l )aH(9 k )R' 1 {i)a{6 k ) w H (i)^ 1 (i)w(i) » 



= R- 1 {i)a{9 k )a H {9 k ) 
aH{9 k )R- 1 (i)a{9 k ) 

This completes the derivation and the simplification. 



(63) 
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Fig. 1. Schematic of a linear antenna array system with interferers. 
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Fig. 2. Schematic of the proposed reduced-rank scheme. 



TABLE I 

Computational complexity of LCMV algorithms. 



Algorithm 
Full-rank-SG (4J 



Full-rank-RLS |9| 
Proposed-SG (22] 
Proposed-RLS 
MSWF-SG 03 
MSWF-RLS E) 
AVF [19] 



Additions 
3M + 1 

3M 2 - 2M + 3 

3DM + 2M 
+2D - 2 
3M 2 - 2M + 3 
+3D 2 - 8D + 3 
DM 2 - M 2 
+3D-2 
DM 2 + M 2 + 6D 2 
-8D + 2 
D((M) 2 + 3(M - l) 2 ) - 1 
+D(5(M -!) + !) + 2M 



Multiplications 
3M +2 

6M 2 + 2M + 2 

3DM + M 
+5D + 2 
7M 2 + 2M 
+7D 2 + 9D 
DM 2 - M 2 
+2DM + 4D + 1 

DM 2 + M 2 
+2DM + 3D + 2 
D{4M 2 + 4M + 1) 
+4M + 2 
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Fig. 3. Complexity in terms of arithmetic operations against M. 
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M=32, K-6 users, SNR-15 dB 
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Fig. 4. MSE analytical versus simulated performance for the proposed 
reduced-rank SG algorithm. 





Fig. 7. SINR performance of LCMV (a) SG and (b) RLS algorithms against 
snapshots with M = 24, SNR = 12 dB with automatic rank selection. 



